Visualizing Study Profiles Using the GMDS Competency Catalog for Medical Informatics Programs.

BACKGROUND: Medical informatics programs cover a variety of topics. OBJECTIVES: To test the utility of the GMDS medical informatics competency catalog in comparing programs by developing study profiles. METHODS: Coverage of 234 competencies is recorded and visualized in a spider diagram. RESULTS: Spider diagrams allow visualizing various study profiles. CONCLUSION: The GMDS catalog seems useful for comparing medical informatics study programs, e.g., for interested students, employers, or accreditation reviewers.

Agile eHealth Usability Evaluation: A Triangulative Approach to Promoting the Usability of eHealth Systems.

BACKGROUND: Usability evaluation is difficult to reconcile with agile software development for eHealth systems, because traditional usability evaluation is often complex and cumbersome to implement. However, obtaining prospective users' feedback during agile software development is crucial for improving the usability of eHealth systems, which is why there is an increasing need for agile eHealth usability evaluation. OBJECTIVE: This study investigates whether agile usability evaluations are suitable to evaluate patient-centered eHealth systems being agile developed in health care and are applicable for prospective users, such as older persons suffering from age-related declines. METHODS: A triangulation study was conducted combining iterative expert interviews with an exploratory case study. RESULTS: The triangulation study revealed that the implementation of an agile eHealth usability evaluation with prospective users such as older persons proved to be possible. CONCLUSION: Established eHealth usability evaluation methods must be further evolved to address age-related impairments of older persons.

One Health: Insights from Organizational & Social, Technology Assessment and Human Factors Perspectives.

OBJECTIVES: To offer diverse but complementary perspectives on how biomedical and health informatics can be informed by and help to achieve the vision of One Health. METHODS: Overview of key considerations and critical discussion of common themes, barriers and opportunities, based on collaborative review by International Medical Informatics Association (IMIA) working group members active in related fields. RESULTS: Health and care systems are complex sociotechnical systems that need explicit design and implementation strategies to align with the goals of One Health. The evidence-based health informatics paradigm and associated frameworks for evaluation of digital health technologies need to broaden their scope to take full account of the One Health approach. Informatics has specific contributions to make to One Health, for example by improved user experience reducing energy consumption and effective app design enhancing medication adherence. CONCLUSIONS: One Health is inherently intertwined with ergonomic, sociotechnical and evaluation perspectives in biomedical and health informatics. Health is a planetary issue that requires interdisciplinary collaborative action. The theories and principles of biomedical and health informatics offer many opportunities to transform digital health technology to better serve the One Health agenda.

A Digital Box and Block Test for Hand Dexterity Measurement: Instrument Validation Study.

BACKGROUND: The Box and Block Test (BBT) measures unilateral gross manual dexterity and is widely used in clinical settings with a wide range of populations, including older people and clients with neurological disorders. OBJECTIVE: In this study, we present a newly developed digitized version of the BBT, called the digital BBT (dBBT). The physical design is similar to the original BBT, but the dBBT contains digital electronics that automate the test procedure, timing, and score measurement. The aim of this study is to investigate the validity and reliability of the dBBT. METHODS: We performed measurements at 2 time points for 29 healthy participants. BBT and dBBT were used at the first measurement time point, and dBBT was used again at the second measurement time point. Concurrent validity was assessed using the correlation between BBT and dBBT, the paired t test, and the Bland-Altman analysis. Test-retest reliability and interrater reliability were examined using the interclass correlation coefficient (ICC) by repeated measures with the dBBT within an interval of 10 days. RESULTS: Our results showed moderate concurrent validity (r=0.48, P=.008), moderate test-retest reliability (ICC 0.72, P<.001), a standard error of measurement of 3.1 blocks, and the smallest detectable change at a 95% CI of 8.5 blocks. Interrater reliability was moderate with an ICC of 0.67 (P=.02). The Bland-Altman analysis showed sufficient accuracy of the dBBT in comparison with the conventional BBT. CONCLUSIONS: The dBBT can contribute to objectifying the measurement of gross hand dexterity without losing its important characteristics and is simple to implement.

The need to strengthen the evaluation of the impact of Artificial Intelligence-based decision support systems on healthcare provision.

Despite the renewed interest in Artificial Intelligence-based clinical decision support systems (AI-CDS), there is still a lack of empirical evidence supporting their effectiveness. This underscores the need for rigorous and continuous evaluation and monitoring of processes and outcomes associated with the introduction of health information technology. We illustrate how the emergence of AI-CDS has helped to bring to the fore the critical importance of evaluation principles and action regarding all health information technology applications, as these hitherto have received limited attention. Key aspects include assessment of design, implementation and adoption contexts; ensuring systems support and optimise human performance (which in turn requires understanding clinical and system logics); and ensuring that design of systems prioritises ethics, equity, effectiveness, and outcomes. Going forward, information technology strategy, implementation and assessment need to actively incorporate these dimensions. International policy makers, regulators and strategic decision makers in implementing organisations therefore need to be cognisant of these aspects and incorporate them in decision-making and in prioritising investment. In particular, the emphasis needs to be on stronger and more evidence-based evaluation surrounding system limitations and risks as well as optimisation of outcomes, whilst ensuring learning and contextual review. Otherwise, there is a risk that applications will be sub-optimally embodied in health systems with unintended consequences and without yielding intended benefits.

Predicting mHealth Acceptance Using the UTAUT2 Technology Acceptance Model: A Mixed-Methods Approach.

BACKGROUND: Mobile health (mHealth) apps are increasingly used in healthcare to support people with chronic diseases such as diabetes. mHealth acceptance is crucial for using them. Due to acceptance problems, however, mHealth apps are not used by all chronic disease patients. To predict user acceptance, technology acceptance models such as UTAUT2 are used. However, UTAUT2 was not explicitly developed for the mHealth context. OBJECTIVES: This study investigates if additional health-related constructs could increase the predictive power of the UTAUT2 model. METHODS: A mixed-methods design, comprising an initial qualitative methods triangulation study that consisted of a literature search, expert interviews, and patient interviews, and a subsequent quantitative cross-sectional survey with 413 patients was used. RESULTS: The mixed-methods study revealed and validated two new constructs relevant for predicting mHealth acceptance not represented in the UTAUT2 model: "perceived disease threat" and "trust". CONCLUSION: The UTAUT2 model was successfully extended by two new constructs relevant to the mHealth context.

Logic Models for Evaluation of Complex Health Information Systems.

BACKGROUND: Complex health IT needs to be planned and evaluated. OBJECTIVES: To propose logic models for the evaluation of complex health IT. METHODS: Logic models describe input, activities, output, outcome, and impact. RESULTS AND CONCLUSION: This first example of a logic model for patient portals shows how health IT planning and evaluation may benefit from logic models.

IT risk management for medical devices in hospital IT networks: a catalogue of measures and indicators.

OBJECTIVES: Connecting medical devices to hospital IT networks can create threats that must be covered by IT risk management. In practice, implementing such risk management is not trivial because the IEC 80001-1, as the existing state-of-the-art, do not describe sufficiently concrete implementation measures or evaluation indicators. The aim of the present work was to develop and evaluate a catalogue of measures and indicators to help hospitals implement and evaluate risk management in accordance with IEC 80001-1. METHODS: We conducted a Delphi study with 22 experts. In the first round, we performed interviews to identify implementation measures and evaluation indicators using qualitative content analysis. In the second round, a quantitative experts' survey confirmed the results of the first survey round and identified relationships between the measures and indicators. Based on these results, we then developed a catalogue containing the identified measures and indicators. Finally, we performed a case study to verify the practicability of this catalogue. RESULTS: We developed and verified a catalogue of 49 measures and 18 indicators to help hospitals implement and evaluate risk management following IEC 80001-1. The case study confirmed the practicability of the catalogue. DISCUSSION: Compared with IEC 80001-1, our catalogue goes into further detail to offer hospitals a stepwise implementation and evaluation approach. However, the catalogue must be tested in further case studies and evaluated in terms of generalisation. CONCLUSIONS: The catalogue will enable hospitals to overcome recent difficulties in implementing and evaluating IT risk management for medical devices according to IEC 80001-1.

A Linked Open Data-Based Terminology to Describe Libre/Free and Open-source Software: Incremental Development Study.

BACKGROUND: There is a variety of libre/free and open-source software (LIFOSS) products for medicine and health care. To support health care and IT professionals select an appropriate software product for given tasks, several comparison studies and web platforms, such as Medfloss.org, are available. However, due to the lack of a uniform terminology for health informatics, ambiguous or imprecise terms are used to describe the functionalities of LIFOSS. This makes comparisons of LIFOSS difficult and may lead to inappropriate software selection decisions. Using Linked Open Data (LOD) promises to address these challenges. OBJECTIVE: We describe LIFOSS systematically with the help of the underlying Health Information Technology Ontology (HITO). We publish HITO and HITO-based software product descriptions using LOD to obtain the following benefits: (1) linking and reusing existing terminologies and (2) using Semantic Web tools for viewing and querying the LIFOSS data on the World Wide Web. METHODS: HITO was incrementally developed and implemented. First, classes for the description of software products in health IT evaluation studies were identified. Second, requirements for describing LIFOSS were elicited by interviewing domain experts. Third, to describe domain-specific functionalities of software products, existing catalogues of features and enterprise functions were analyzed and integrated into the HITO knowledge base. As a proof of concept, HITO was used to describe 25 LIFOSS products. RESULTS: HITO provides a defined set of classes and their relationships to describe LIFOSS in medicine and health care. With the help of linked or integrated catalogues for languages, programming languages, licenses, features, and enterprise functions, the functionalities of LIFOSS can be precisely described and compared. We publish HITO and the LIFOSS descriptions as LOD; they can be queried and viewed using different Semantic Web tools, such as Resource Description Framework (RDF) browsers, SPARQL Protocol and RDF Query Language (SPARQL) queries, and faceted searches. The advantages of providing HITO as LOD are demonstrated by practical examples. CONCLUSIONS: HITO is a building block to achieving unambiguous communication among health IT professionals and researchers. Providing LIFOSS product information as LOD enables barrier-free and easy access to data that are often hidden in user manuals of software products or are not available at all. Efforts to establish a unique terminology of medical and health informatics should be further supported and continued.

Recommendations of the International Medical Informatics Association (IMIA) on Education in Biomedical and Health Informatics: Second Revision.

BACKGROUND: The purpose of educational recommendations is to assist in establishing courses and programs in a discipline, to further develop existing educational activities in the various nations, and to support international initiatives for collaboration and sharing of courseware. The International Medical Informatics Association (IMIA) has published two versions of its international recommendations in biomedical and health informatics (BMHI) education, initially in 2000 and revised in 2010. Given the recent changes to the science, technology, the needs of the healthcare systems, and the workforce of BMHI, a revision of the recommendations is necessary. OBJECTIVE: The aim of these updated recommendations is to support educators in developing BMHI curricula at different education levels, to identify essential skills and competencies for certification of healthcare professionals and those working in the field of BMHI, to provide a tool for evaluators of academic BMHI programs to compare and accredit the quality of delivered programs, and to motivate universities, organizations, and health authorities to recognize the need for establishing and further developing BMHI educational programs. METHOD: An IMIA taskforce, established in 2017, updated the recommendations. The taskforce included representatives from all IMIA regions, with several having been involved in the development of the previous version. Workshops were held at different IMIA conferences, and an international Delphi study was performed to collect expert input on new and revised competencies. RESULTS: Recommendations are provided for courses/course tracks in BMHI as part of educational programs in biomedical and health sciences, health information management, and informatics/computer science, as well as for dedicated programs in BMHI (leading to bachelor's, master's, or doctoral degree). The educational needs are described for the roles of BMHI user, BMHI generalist, and BMHI specialist across six domain areas - BMHI core principles; health sciences and services; computer, data and information sciences; social and behavioral sciences; management science; and BMHI specialization. Furthermore, recommendations are provided for dedicated educational programs in BMHI at the level of bachelor's, master's, and doctoral degrees. These are the mainstream academic programs in BMHI. In addition, recommendations for continuing education, certification, and accreditation procedures are provided. CONCLUSION: The IMIA recommendations reflect societal changes related to globalization, digitalization, and digital transformation in general and in healthcare specifically, and center on educational needs for the healthcare workforce, computer scientists, and decision makers to acquire BMHI knowledge and skills at various levels. To support education in BMHI, IMIA offers accreditation of quality BMHI education programs. It supports information exchange on programs and courses in BMHI through its Working Group on Health and Medical Informatics Education.

Extension of the Unified Theory of Acceptance and Use of Technology 2 model for predicting mHealth acceptance using diabetes as an example: a cross-sectional validation study.

OBJECTIVES: Mobile health applications are instrumental in the self-management of chronic diseases like diabetes. Technology acceptance models such as Unified Theory of Acceptance and Use of Technology 2 (UTAUT2) have proven essential for predicting the acceptance of information technology. However, earlier research has found that the constructs "perceived disease threat" and "trust" should be added to UTAUT2 in the mHealth acceptance context. This study aims to evaluate the extended UTAUT2 model for predicting mHealth acceptance, represented by behavioral intention, using mobile diabetes applications as an example. METHODS: We extended UTAUT2 with the additional constructs "perceived disease threat" and "trust". We conducted a web-based survey in German-speaking countries focusing on patients with diabetes and their relatives who have been using mobile diabetes applications for at least 3 months. We analysed 413 completed questionnaires by structural equation modelling. RESULTS: We could confirm that the newly added constructs "perceived disease threat" and "trust" indeed predict behavioural intention to use mobile diabetes applications. We could also confirm the UTAUT2 constructs "performance expectancy" and "habit" to predict behavioural intention to use mobile diabetes applications. The results show that the extended UTAUT2 model could explain 35.0% of the variance in behavioural intention. DISCUSSION: Even if UTAUT2 is well established in the information technologies sector to predict technology acceptance, our results reveal that the original UTAUT2 should be extended by "perceived disease threat" and "trust" to better predict mHealth acceptance. CONCLUSION: Despite the newly added constructs, UTAUT2 can only partially predict mHealth acceptance. Future research should investigate additional mHealth acceptance factors, including how patients perceive trust in mHealth applications.

The Role of Formative Evaluation in Promoting Digitally-based Health Equity and Reducing Bias for Resilient Health Systems: The Case of Patient Portals.

OBJECTIVES: Patient portals are increasingly implemented to improve patient involvement and engagement. We here seek to provide an overview of ways to mitigate existing concerns that these technologies increase inequity and bias and do not reach those who could benefit most from them. METHODS: Based on the current literature, we review the limitations of existing evaluations of patient portals in relation to addressing health equity, literacy and bias; outline challenges evaluators face when conducting such evaluations; and suggest methodological approaches that may address existing shortcomings. RESULTS: Various stakeholder needs should be addressed before deploying patient portals, involving vulnerable groups in user-centred design, and studying unanticipated consequences and impacts of information systems in use over time. CONCLUSIONS: Formative approaches to evaluation can help to address existing shortcomings and facilitate the development and implementation of patient portals in an equitable way thereby promoting the creation of resilient health systems.

Desiderata for a New Generation of EHRs for Inclusive Healthcare.

OBJECTIVES: This research addresses several factors relevant to inequity in healthcare that may be susceptible to being addressed in a new generation of electronic health records (EHRs). METHODS: Through a scoping review of the literature, inequities related to ethnicity, gender, and socioeconomic aspects in healthcare in general and, more specifically in EHRs, have been considered. Papers have been identified between 2011 and 2022 in three categories: EHR, gender inequalities, and ethnicity inequalities. RESULTS: Twenty-two recommendations have been identified within the scope of the three categories indicated above. These exposed requirements focus on two spheres: (1) technical sphere, mainly focused on the characteristics and tools that the EHR should develop from taking into account the studied inequalities; and (2) clinical sphere, which mainly affects patients, health professionals, and health providers. CONCLUSIONS: Ethnic and gender inequalities are essential factors to take into account when diagnosing, monitoring, preventing, and treating a patient. These factors give us the keys to discovering recommendations for a new generation of EHRs to help mitigate these needs.

Using the Taxonomy of Patient Portals to Classify the ELGA Patient Portal.

BACKGROUND: Patient portals may support patient engagement, yet they may differ largely in their characteristics. OBJECTIVES: To compare the Austrian patient portal with 10 portals from six other countries using the TOPCOP Taxonomy. METHODS: We described the portals using openly available information. RESULTS: The Austrian patient portal shows basic functionality but lacks further functions that other portals partly offer. CONCLUSION: Comparing portals using TOPCOP is possible and shows functions to improve usefulness of portals.

Process Mining of Nursing Routine Data: Cool, but also Useful?

BACKGROUND: Process mining is a promising field of data analytics that is yet to be applied broadly in healthcare. It can streamline the care process, leading to a higher quality of care, increased patient safety and lower costs. OBJECTIVES: To get deeper insights into the emergence and detectability of delirium in a gerontopsychiatric setting. METHODS: We use process mining to create process models from routinely collected, anonymised nursing data from two gerontopsychiatric wards. We analyse these models to get a longitudinal view of the care processes. RESULTS: The process models comprise all activities during patients' stays but are too extensive and challenging to interpret due to the wide variation in care paths. Although the models give insight into frequent paths and activities, they are insufficient to explain the emergence of delirium meaningfully. No apparent difference between stays with or without delirium could be detected. CONCLUSION: Conducting process mining on routinely collected data is easy, but the interpretation of the results was a challenge. We identified four limitations associated with using this data and gave recommendations on adapting it for further analysis.

Classification of Patient Portals Described in Evaluation Studies Using the TOPCOP Taxonomy.

Many patient portals have been introduced and evaluated in recent years. The results of evaluation studies are difficult to compare, however, as the evaluated patient portal is often not clearly or only incompletely described in the publication. This problem is common to evaluations in health informatics. We evaluated the completeness of descriptions of patient portals in 15 exemplary evaluation publications using the TOPCOP taxonomy. Our results show that core functionalities such as portal design, patient communication, educational features, or system notifications were quite clearly described in all 15 evaluation studies. Other descriptions, such as web accessibility or data management, were often not provided. We conclude that taxonomies such as TOPCOP should be used and even required for describing interventions in evaluation papers.

Suitability of the Unified Theory of Acceptance and Use of Technology 2 Model for Predicting mHealth Acceptance Using Diabetes as an Example: Qualitative Methods Triangulation Study.

BACKGROUND: In recent years, the use of mobile health (mHealth) apps to manage chronic diseases has increased significantly. Although mHealth apps have many benefits, their acceptance is still low in certain areas and groups. Most mHealth acceptance studies are based on technology acceptance models. In particular, the Unified Theory of Acceptance and Use of Technology 2 (UTAUT2) model was developed to predict technology acceptance in a consumer context. However, to date, only a few studies have used the UTAUT2 model to predict mHealth acceptance and confirm its suitability for the health sector. Thus, it is unclear whether the UTAUT2 model is suitable for predicting mHealth acceptance and whether essential variables for a health-related context are missing. OBJECTIVE: This study aims to validate the suitability of UTAUT2 for predicting mHealth acceptance. METHODS: In this study, diabetes was used as an example as mHealth apps are a significant element of diabetes self-management. In addition, diabetes is one of the most common chronic diseases affecting young and older people worldwide. An explorative literature review and guided interviews with 11 mHealth or technology acceptance experts and 8 mHealth users in Austria and Germany were triangulated to identify all relevant constructs for predicting mHealth acceptance. The interview participants were recruited by purposive sampling until theoretical saturation was reached. Data were analyzed using structured content analysis based on inductive and deductive approaches. RESULTS: This study was able to confirm the relevance of all exogenous UTAUT2 constructs. However, it revealed two additional constructs that may also need to be considered to better predict mHealth acceptance: trust and perceived disease threat. CONCLUSIONS: This study showed that the UTAUT2 model is suitable for predicting mHealth acceptance. However, the model should be extended to include 2 additional constructs for use in the mHealth context.